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(54) INFORMATION INPUT DEVICE AND GAME DEVICE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To facilitate recognition of the 
position of an information input tool such as a hand 
controller by an image processing system and to put a 
virtual image of an image display device, etc., together with 



a virtual image of the information input tool. 
SOLUTION: The hand controller 1 with a reference surface 
setting function capable of picking up an image is equipped 
with four light emitting diodes LED1 to LED4 fitted at 
specific positions in the peripheral area of operation buttons 
52, 53, 55, and 56 and a blink control circuit 13 which 
controls the input and output of the light emitting diodes 
LED1 to LED4. This blink control circuit 13 performs blink 
control so that the blink patterns of the light emitting diodes 
LED1 to LED4 are different. When an image of the hand 
controller 1 is picked up by a special pickup device like a 
panning CCD device, this constitution makes it easy to 




specify the positions of the light emitting diodes LED1 to 
LED4 as compared with a case wherein the light emission 
patterns of the light emitting diodes LEDl to LED4 are 
brought under non-blinking control. 
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l.This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim l]An information input device which is provided with the following and characterized by 
carrying out flashing control of said control means so that blink patterns of said light source may 
differ. 

Two or more light sources which are the information input, devices with a manual operation 
button for information inputting which can be picturized, and were attached to a specific position 
of adjacent spaces of said manual operation button at least. 
A control means which controls input and output of said light source. 

[Claim 2]When said manual operation button characterized by comprising the following is 
provided. 

A left manual operation part which makes said manual operation button operate it with the left 
hand. 

A right-hand final controlling element which makes said manual operation button operate it with 
the right hand. 

[Claim 3]The information input device according to claim 1 which is a case where said manual 
operation button and a light source are provided, and is characterized by establishing a control 
means which changes input by said manual operation button into blink patterns by said light 
source, and is sent to an image processing system. 

[Claim 4] A device which combines a picture of a virtual body in three dimensions to an external 
world picture in which an operator belongs, comprising: 

An information input means with a manual operation button for information inputting which can 
be picturized. 

A position recognizing means which recognizes said information input means on real space 
where said operator belongs. 

A light source of three or more points which equipped a picture on virtual space of an 
information input means recognized by said position recognizing means with a synthesizing 
means which compounds arbitrary virtual images, in which said position recognizing means was 
attached to a specific position of said information input means and which blinks at least so that 
blink patterns may differ. 

A calculating means which carries out image processing of the luminance signal of blink patterns 
pass and photograph and according to an imaging means of business, and said imaging means 
picturized so that said light source may be poured to a predetermined imaging direction, searches 
for a position of three points of said light source, connects a position of said light source of three 
points after that, and asks for a base level. 

[Claim 5]When a manual operation button is provided in said information input means 
characterized by comprising the following. 



A left manual operation part which said information input means makes operate said manual 
operation button with the left hand. 

A right-hand final controlling element which makes said manual operation button operate it with 
the right hand. 

[Claim 6]The game device according to claim 4 which is a case where said position recognizing 
means and a synthesizing means are established, and is characterized by making said 
synthesizing means as [ compound / a virtual image which imagines arbitrary image display 
devices to an information input means of virtual space recognized by said position recognizing 
means ]. 

[Claim 7]The game device according to claim 4 which is a case where said position recognizing 
means and a synrtiesizing means are established, and is characterized by making said 
synthesizing means as [ compound / a virtual image which imagines arbitrary characters to an 
information input means on virtual space recognized by said position recognizing means ]. 
[Claim 8]In the style of the above, when transmitting a signal charge which a two-dimensional 
imaging device with two or more optoelectric transducers which photograph by carrying out and 
constitute each pixel in an imaging means of business was used, and was obtained from said 
optoelectric transducer in the predetermined direction, The game device according to claim 4 
making at least as [ read / during the identical field / from multiple times and said optoelectric 
transducer / said signal charge ]. 

[Claim 9] Are a case where said imaging means and a calculating means are established, and said 
calculating means. Change into a spatial arrangement pattern which accomplishes an XY plane 
including three luminescent spots about blink patterns of a luminance signal by said imaging 
means, and said arrangement pattern top is scanned. The game device according to claim 4 
making as [ recognize / by searching for a position coordinate of three luminescent spots, and 
connecting said position coordinate of three points at least, / said base level ]. 
[Claim 10] When the X-axis is set as an axis which said calculating means is passed on an 
arrangement pattern which accomplishes an XY plane including three luminescent spots, sets a 
Y-axis as an imaging direction, and intersects perpendicularly with this Y-axis, When a position 
from which a luminance-signal value which added a luminance-signal value to said sink imaging 
direction, plotted on the X-axis, and was plotted on said X-axis serves as the maximum is 
detected, and three X coordinate values are calculated and it scans to Y shaft orientations on said 
arrangement pattern. The game device according to claim 4 searching for respectively a 
luminescent spot position which emitted light to the beginning among two or more luminescent 
spots located in a line with said sink imaging direction as a Y coordinate value corresponding to 
X coordinate value. 

[Claim 1 l]The 1st image display element that displays one side of an external world picture by 
imaging means in which said synthesizing means picturizes an extemal world picture in which 
an operator belongs, and said imaging means, a virtual image of an image display means 
prepared beforehand, and a compound stereo image, Are another side of said stereo image a head 
mount display with the 2nd image display element to display, and said head mount display. The 
game device according to claim 4 making as [ lead / to an operator's eyeball / an operator's face 
or a head is equipped, pile up a stereo image by said 1st image display element, and a stereo 
image by said 2nd image display element, and ]. 

[Claim 12] A liquid crystal shutter which opens and closes incident light in order that said 
synthesizing means may incorporate an extemal world picture in which an operator belongs, An 



image display element which displays a picture of a virtual body for compounding to said 
external world picture, It is a head mount display with an optical means which leads a picture of 
a virtual body by said image display element, and an external world picture in which an operator 
who passed said liquid crystal shutter belongs to the operator's eyeball. When an operator's face 
or a head is equipped with said head mount display and said liquid crystal shutter is opened, The 
game device according to claim 4 making as [ lead / to an operator's eyeball / lay a picture of a 
virtual body by said image display element on top of an external world picture on real space 
where an operator who passed said liquid crystal shutter belongs, and ]. 
[Claim 13] A control means which is a case where said manual operation button and a light 
source are provided, and changes input by said manual operation button into blink patterns by 
said light source. An imaging means which picturizes blink patterns concerning said input 
changed by said control means. The game device according to claim 4, wherein an image 
processing means which carries out image processing of the photodetection signal by blink 
patterns picturized by said imaging means, and searches for input by said manual operation 
button is established. 



[Translation done,] 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]This invention is applied to the character controller adapting the position 
recognition mechanisms and this which make an image processing system etc. recognize the 
existence position of an information input tool with a manual operation button, etc., etc., and 
relates to a suitable information input device and game device. 

[0002] Attach several light sources in which blink patterns differ in detail in specific positions, 
such as an information input tool with a manual operation button which can be picturized, and 
enable it to recognize the position of the information input tool easily by an image processing 
system based on the light source, and. It enables it to compound the virtual image of an image 
display device etc. to the virtual image of the information input tool. 
[0003] 

[Description of the Prior Art]In recent years, the game device for providing an operator with 
virtual reality ranging over two or more picture display surfaces has appeared with improvement 
in the display technique based on a virtual reality (virtual reality). 

[0004]This kind of stereoscopic display device is looked at by the technical literature of JP,9- 
237353,A, According to this technical literature, the projection space of the size of about several 
meters every direction is provided, a display is arranged in each field, and the three dimentional 
display of the picture of virtual bodies, such as a dinosaur, a monster, and arms, is carried out 
from each display. And if an operator wears glasses with a liquid crystal shutter and stands on 
the projection space, he will be made as [ be / it / in the same place as the virtual body displayed 
with each display ]. 

[0005]The arms which an operator gains on virtual space are picturized with a camera, and 
image processing is carried out so that a virtual body may react by motion of the arms. Thereby, 



the operator can do a time slip to the primitive age thousands of years ago, and can perform 

dinosaur extermination etc. like a game. 

[0006] 

[Problem(s) to be Solved by the Invention]By the way, when an operator tries to make an image 
processing system recognize information input devices, such as arms gained on real space, 
according to the identification method of the information input device of a conventional system, 
The background image containing the information input device is picturized, the contour part of 
the information input device is extracted, and the reference pattern about the information input 
device stored beforehand is compared with the contour pattern of the information input device. 
[0007]Therefore, when only the information input device tends to be made to recognize by an 
image processing system and it is going to combine a virtual body picture etc. to the information 
input device on virtual space, the computational complexity concerning the pattern recognition 
of the image processing system increases, or the burden of the computing unit becomes heavy. 
[0008]By this, for example on an information input tool with manual operation buttons, such as a 
hand controller etc. of the real space where an operator belongs, The liquid crystal display as an 
image display device, a CRT device, etc. are made to exist virtually, If the pattem recognition 
method of a conventional system is applied as if is when it is going to constitute a game device 
which carries out character display control of the image display device on virtual space based on 
operation of the information input tool on the real space. Since it is difficult to recognize an 
information input device easily by an image processing system, the pattem recognition 
processing becomes large-scale, image processing for recognizing a base level becomes 
complicated, or the computational complexity at that time increases, and there is a problem that 
it is connected with cost hikes, such as a game device. 

[0009]Then, this invention is created in view of the above-mentioned technical problem, and is a 
thing. 

the purpose - it enables it to recognize easily the information input tool with a manual operation 
button in which which image pick-up is possible by an image processing system, and is 
providing the information input device and game device which enabled it to compound the 
virtual image of an image display device etc. to the virtual image of the information input tool. 

[0010] 

[Means for Solving the Problem]Two or more light sources which a technical problem 
mentioned above is an information input device with a manual operation button for information 
inputting which can be picturized, and were attached to a specific position of adjacent spaces of a 
manual operation button at least, It has a control means which controls input and output of the 
light source, and the control means is solved with an information input device carrying out 
flashing control so that blink patterns of a light source may differ. 

[0011]Since according to the information input device of this invention flashing control of two or 
more light sources attached to a specific position of adjacent spaces of a manual operation button 
is carried out so that blink patterns may be changed by a control means. When it passed and 
photographs and the information input device is picturized with a special-effects device like a 
CCD device, compared with a case where non-flashing control of the lighting pattem of two or 
more light sources is carried out, a position of the light source can be pinpointed easily. 
[0012]Therefore, since an image processing system can be made to recognize a position of an 
information input device easily from a position of the light source, it is fully applicable to a game 
device etc. which compound an image picture of arbitrary image display devices to an 



information input device on virtual space. 

[00 13] As for a game device conceming this invention, this invention is characterized by that a 
device which combines a picture of a virtual body in three dimensions to an external world 
picture in which an operator belongs comprises the following. 

An information input means with a manual operation button for information inputting which can 
be picturized. 

A position recognizing means which recognizes an information input means on real space where 
the operator belongs. 

A light source of three or more points which equipped a picture on virtual space of an 
information input means recognized by the position recognizing means with a synthesizing 
means which compounds arbitrary virtual images, in which a position recognizing means was 
attached to a specific position of the information input means and which blinks at least so that 
blink patterns may differ. 

A calculating means which carries out image processing of the luminance signal of blink patterns 
pass and photograph and according to an imaging means and an imaging means of business 
picturized so that the light source may be poured to a predetermined imaging direction, searches 
for a position of three points of the light source, connects a position of the light source of three 
points after that, and asks for a base level. 

[0014]Since an image processing system can be made to recognize a position of an information 
input means easily from a position of a light source which an above-mentioned information input 
device was applied and was attached to a specific position of adjacent spaces of a manual 
operation button according to the game device conceming this invention, A virtual character 
controller etc. which compound CRT devices arbitrary as a monitor and a virtual image of a 
liquid crystal display etc. to an information input means on virtual space, and control a character 
can be constituted. 
[0015] 

[Embodiment of the Invention]Hereafter, the information input device and game device as an 
embodiment of this invention are explained, referring to drawings. 

[0016](1) Information input device drawing 1 as an embodiment is a perspective view showing 
the example of composition of the information input device as each embodiment conceming this 
invention. Attach several light sources in which blink patterns differ in the specific position of 
the information input tool with a manual operation button which can be picturized in this 
embodiment, and enable it to recognize the position of that information input tool easily by an 
image processing system based on that light source, and. It enables it to compound the virtual 
image of an image display device etc. to the virtual image of the information input tool. 
[0017]The picture of a virtual body is made easy to recognize by the image processing system of 
the game device etc. which are compounded in three dimensions to the external world picture in 
which the information input device conceming this invention is an information input tool with a 
manual operation button which can be picturized, and an operator belongs. In the information 
input device 1 which can be picturized here, in the information input tool which has the shape 
which divides space, it passes and photographs and what is photographed [ passes and ] and 
made with special imaging devices, such as a CCD device, is said. This sink **** means the 
photographing mode which passes, photographs and reads a signal charge from multiple times 
and optoelectric transducers (photo-diode etc.) during the identical field in a CCD device. 
[0018]This information input device has accomplished the both-hands operation type 



information input tool (henceforth a hand controller) 1 shown in drawing 1 . Shape which has 
arranged symmetrically the handle which a body part shows to drawing 1 is accomplished, and 
character controllers, such as a Playstation (Sony: registered trademark), consist of the hand 
controllers 1 of this example. 

[0019]The body part of this hand controller 1 really operates orthopedically in the predetermined 
case shape which mentioned ABS plastics above with the ejection forming metal mold device 
etc. which it is classified into the left-hand final controlling element 57, the right-hand final 
controlling element 58, and the pars intermedia 59, for example, are not illustrated. The left-hand 
final controlling element 57 has the cylindrical operation panel part 57A and the cylindrical 
handshaking part 57B. The two manual operation buttons 52 and 53 are formed in the operation 
panel part 57A. The manual operation button 52 and 53 are operated with the left-hand thumb, 
and if these manual operation buttons 52 and 53 are pushed, character directions information will 
be generated. 

[0020]This character directions information is for controlling a motion of the character on a 
display screen, for example, is a conmiand at the time of moving a character to the left, or flying, 
springing a character, or discharging a bullet etc. towards an opponent character from arms etc., 
for example, a character holds. The jog dial 54 is formed in the side of the left-hand final 
controlling element 57, and it is generated when control information other than character 
directions information, etc. rotate the jog dial 54. 

[0021]It has the operation panel part 58 A also with the cylindrical right-hand final controlling 
element 58, and the cylindrical handshaking part 58B. The two manual operation buttons 55 and 

56 are formed in the operation panel part 5 8 A. The manual operation button 55 and 56 are 
operated with a right hand thumb, and if these manual operation buttons 55 and 56 are pushed, 
character directions information will be generated. It is for character directions information 
controlling a motion of the character on a display screen. 

[0022]It is connected by the pars intermedia 59 between this right-hand final controlling element 

57 and the right-hand final controlling element 58. The transmission section 14 is established in 
the upper surface of the pars intermedia 59, the character directions information by a manual 
operation button is modulated to a predetermined transmission signal, and it may be made to 
transmit in this example. A wireless transmitter, an infrared-ray-emission machine, etc. are used 
for the transmission section 14. 

[0023]In this example, the four light emitting diodes LED1-LED4 with which blink patterns 
differed are formed in the specific position of the hand controller 1. These four light emitting 
diodes LED1-LED4 are good to attach to the flat part which accomplishes the base level of the 
hand controller 1 and does not have unevenness preferably. In this example, light emitting diode 
LEDl is attached to the upper bed of the right-hand final controlling element 57, the light 
emitting diodes LED2 and LED3 are attached to the pars intermedia 59, and light emitting diode 
LED4 is attached to the upper bed of the right-hand final controlling element 58. 
[0024]As coordinates of the four light emitting diodes LED1-LED4 for setting up the base level 
of this hand controller 1, respectively (xl, yl), (x2, y2), (x3, y3), and (x4, y4) are given (on 
virtual space, it is equivalent to the base level which is going to compound the liquid crystal 
display 5 and the virtual image of a CRT device etc.). 

[0025]In order to exhibit the function as that mark part, these four light emitting diodes LEDl- 
LED4 are got blocked, and flashing control is carried out at least so that blink patterns may 
differ, so that the position of the hand controller 1 may become clear. The blink patterns of these 
light emitting diodes LED1-LED4 are picturized so that it might be attached to the virtual image 



solid synthesizer unit etc. which are called special glass TRON, it may pass, it may photograph 
and it may pass to a predetermined imaging direction with a CCD device, this ~ passing ~ 
photographing - it is because an above-mentioned base level is pinpointed from the fitting 
location of the four light emitting diodes LED1-LED4. Drawing 10 and drawing 11 e xplain 
pinpointing of this base level. 

[0026]In the above-mentioned pars intermedia 59, the flashing control circuit 13 is formed as a 
control means, and input and output of the light emitting diodes LED1-LED4 are controlled. For 
example, in the flashing control circuit 13 shown in drawing 2 , in order to make an image 
processing system recognize the position of the hand controller 1 concerned with sufficient 
reproducibility, flashing control is carried out so that the blink patterns of the light emitting 
diodes LED1-LED4 may differ. 

[0027]In this example, the flashing control circuit 13 is IC-chip-ized, this IC chip is built into the 
pars intermedia 59 of the hand controller 1, and flashing control of the predetermined voltage is 
impressed and carried out to the four light emitting diodes LED1-LED4. This flashing control 
circuit 13 has the clock generation part 61. The 1/2 frequency divider 62, the 1/3 frequency 
divider 63, and the 1/4 frequency divider 64 are connected to the clock generation part 61, and 
Clock signal CLKl of predetermined frequency, Clock signal CLK2 which carried out 1 / 2 
dividing of this clock signal CLKl in the 1/2 frequency divider 62, clock signal CLK3 which 
carried out 1/3 dividing in the 1/3 frequency divider 63, and clock signal CLK4 which carried 
out 1 / 4 dividing in the 1/4 frequency divider 64 are outputted. 

[0028]Each clock signals CLK1-CLK4 are supplied to each light emitting diode LEDl, LED2, 
LED3, and LED4 through the resistance R for stabilization. When the hand controller 1 takes the 
interface form of a wired system in this example, a power supply is supplied to the clock 
generation part 61 from the image processing device of a higher rank, etc. In the case of radio 
system, the electric power switch SW is placed between the clock generation part 61, and DC 
power supply E are connected. A small dry cell, a button cell, etc. are used for this power supply 
E. 

[00291 Drawing 3 is a wave form chart showing the example of blink patterns of light emitting 
diode LEDl, LED2, LED3, and LED4. In this example, clock signal CLKl of non-dividing is 
supplied to light emitting diode LEDl, Clock signal CLK2 which carried out 1/2 dividing of 
clock signal CLKl is supplied to light emitting diode LED2, Clock signal CLK3 which carried 
out 1 / 3 dividing of clock signal CLKl is supplied to light emitting diode LED3, and clock 
signal CLK4 which carried out 1/4 dividing of clock signal CLKl is supplied to light emitting 
diode LED4. Therefore, it is controllable to differ four blink patterns, light emitting diode LEDl, 
LED2, LED3, and LED4. 

[0030]Thus, according to the hand controller 1 as this embodiment. Light emitting diode LEDl 
attached to the upper bed of the right-hand final controlling element 57, Light emitting diode 
LED4 attached to the upper bed of the right-hand final controlling element 58, Since flashing 
control of the light emitting diodes LED2 and LED3 attached to the pars intermedia 59 is carried 
out so that blink patterns may be changed by the flashing control circuit 13, When it passed and 
photographs and the hand controller 1 is picturized with a special-effects device like a CCD 
device, compared with the case where non-flashing control of the lighting pattern of two or more 
light sources is carried out, the position of the four light emitting diodes LED1-LED4 can be 
pinpointed easily. 

[0031]Therefore, since an image processing system can be made to recognize the position of the 
hand controller 1 easily from the position of the four light emitting diodes LED1-LED4, It is 



. fully applicable to a game device which compounds the image picture of the liquid crystal 
display 5 and arbitrary image display devices, such as a CRT device, for the hand controller 1 on 
virtual space. 

[0032](2) Game device drawing 4 as a 1st embodiment is a perspective view showing the 
example of composition of the game device 100 as a 1st embodiment concerning this invention. 
In this embodiment, several light sources in which blink patterns differ are attached to the 
specific field of the information input device which can be picturized. It picturizes so that the 
light source of that information input device may be poured to a predetermined imaging 
direction, and image processing of the luminance signal of the light source by this sink image 
pick-up is carried out, the position of a light source is searched for, and it is made as [ compound 
/ to the base level of the information input device to which the position of this light source was 
connected on virtual space / the virtual image of an image display device ]. 
[0033]To the external world picture in which an operator (henceforth a player) belongs, the game 
device 100 shown in drawing 4 . It is a device which carries out the composite display of the 
image picture of a liquid crystal display and arbitrary image display devices, such as a CRT 
device, in three dimensions, and display control of the liquid crystal display on virtual space is 
carried out by a hand controller. This game device 100 has the hand controller 1, special glass 
TRON 2, and the image processing device 3 with a base level setting up function. 
[0034]The hand controller 1 as this information input device is used in front of a player, for 
example, having in both hands. In this example, it has the hand controller 1 by the hand of the 
right and left in front of a player, and is operated so that the left-hand final controlling element 
57, the right-hand final controlling element 58, and the pars intermedia 59 may enter in the 
photographing area of special glass TRON 2. The belt 22 is formed in the body part 21 of this 
special glass TRON 2, and the face of a player is equipped with the body part 21 so that he may 
wear glasses, and the belt 22 is fixed along with the head peripheral part of that player. 
[00351TO special glass TRON 2, it passes at least, and photographs, and CCD device 23 and the 
displaying means 24 are established. The usual CCD imaging device 25 is formed depending on 
the model of special glass TRON 2. It is made as [ recognize / this hand controller 1 and on the 
real space where the position recognition mechanisms 4 as a position recognizing means are 
constituted by CCD device 23 and the image processing device 3 by passing and photographing, 
and a player belongs / the base level of that hand controller 1 ]. 

[0036]When the two-dimensional imaging device of the interline transmission mode which 
passes and photographs in this example and has a vertical transfer part as CCD device 23 is used, 
a signal charge is read from multiple times and an optoelectric transducer to a vertical transfer 
part during the identical field. When the two-dimensional imaging device of the frame transfer 
system which passes and photographs and has a charge storage part as CCD device 23 is used, a 
signal charge is read from multiple times and an optoelectric transducer to a charge storage part 
during the identical field. 

[0037]The image processing device 3 is connected to special glass TRON 2, and image 
processing which recognizes a base level etc. based on the image data which passed and 
photographed and was outputted from CCD device 23 is made. In this example, the image data 
for displaying the virtual image of the liquid crystal display 5, a CRT device, etc. is beforehand 
prepared for the image processing device 3. 

[0038]The displaying means 24 is connected to this image processing device 3, and the hand 
controller 1 recognized by the position detecting mechanism 4 is displayed. In this example, it is 
made as [ exist / in the position to which the base level of the hand controller 1 on real space 



belongs, or its adjacent spaces / the solid virtual image of the liquid crystal display 5 as an image 
display device ]. 

[0039] special glass TRON 2 shown in drawing 5 constituted the nontransparentized type head 
mount display, and mentioned it above with the usual CCD imaging device 25 ~ it passes and 
photographs and has CCD device 23, the liquid crystal display 26 for a right eye display 
(henceforth LCD), and LCD27 for a left eye display. 

[0040]That is, in the position equivalent to the glabella of a player, it passes with the usual CCD 
imaging device 25, and photographs in it, and CCD device 23 arranges, and is arranged, the 
external world picture to which a player belongs by the former is picturized, and the four light 
emitting diodes LED1-LED4 of the hand controller 1 pass and photograph, and are carried out by 
the latter. Therefore, if a player turns its eyes to the hand controller 1 with a base level setting up 
function, it will pass and photograph in the direction of the base level, and CCD device 23 will 
come to be suitable. 

[0041]And the hand controller 1 of the player which LCD26 was attached to the position which 
faces the right eye of the player in special glass TRON 2, for example, was photoed with the 
usual CCD imaging device 25, One side of the stereo image which compounded the virtual 
image of the liquid crystal display 5 prepared beforehand is displayed. LCD27 is attached to the 
position which faces the left eye of the player, and another side of the stereo image which 
compounded the above-mentioned hand controller 1 and the virtual image of the liquid crystal 
display 5 is displayed. 

[0042]The face or the head of a player is equipped with this special glass TRON 2, and it is made 
as [ lead / to the eyeball of a player / the stereo image of above-nientioned LCD26 and the stereo 
image of LCD27 ]. Thereby, the hand controller 1 as a background image by which a player 
belongs, and the virtual image of the liquid crystal display 5 are compounded in the head. 
[0043]Special glass TRON 20 shown in drawing 6 c onstitutes the transmission type head mount 
display, and the usual CCD imaging device 25 is not carried. Therefore, a picture of a 
transmission type head mount display is poured and taken, and it has CCD device 23, the liquid 
crystal shutter 28 for external vvorld picture incorporation, and LCD29 as an image display 
element. 

[0044]For example, if it passes and photographs, CCD device 23 is arranged and a player turns 
its eyes to the hand controller 1 with a base level setting up function, the four light emitting 
diodes LED1-LED4 of the hand controller 1 will pass and photograph, and will be made the 
position equivalent to the glabella of a player. And if the liquid crystal shutter 28 is formed in the 
position equivalent to the left eye and right eye of a player, for example, the liquid crystal shutter 
28 is opened, the real image of the hand controller 1 placed before the player which passed the 
liquid crystal shutter 28 will be directly led to an eyeball. 

[0045JLCD29 is attached to the portion located in the side of the left eye of the player in special 
glass TRON 2, and a right eye, and the virtual image of the liquid crystal display 5 and the 
virtual image of the liquid crystal display 5 are displayed on it like above-mentioned special 
glass TRON 2. Although not illustrated, optical means, such as a polarization beam splitter, are 
established between the liquid crystal shutter 28 and LCD29, and it is made as [ lead / to the 
eyeball of a player / the real image of the hand controller 1 of a player and the virtual image of 
the liquid crystal display 5 and the virtual image of the liquid crystal display 5 ]. Thereby, the 
hand controller 1 as a background image by which a player belongs, and the virtual image of the 
liquid crystal display 5 are compounded in the head. 

[0046]Then, an interline transmission mode passes, it photographs and the internal configuration 



of CCD device 23 is explained, it is shown in drawing 7 — it passes and photographs and CCD 
device 23 has the substrate 31. The photo-diode PHij (i=l-n, j=l-m) is arranged as an 
optoelectric transducer which constitutes 1 pixel on the substrate 3 1 at the matrix form of the n 
sequence xm line. 

[0047]The vertical transfer part 32 of m book is formed in the column direction of this substrate 
as a charge transfer section, and the signal charge read from the photo-diode PHij is transmitted 
perpendicularly (passing and photographing direction) based on the vertical read signal SI. Since 
the horizontal transfer part 33 is connected to this vertical transfer part 32 and that signal charge 
is horizontally transmitted based on the level read signal S2, it passes to the output terminal 34, 
and photographs, and the signal SOUT is outputted. In this example, in order to carry out sink 
****, a signal charge is read from multiple times and the photo-diode PHij to the vertical transfer 
part 32 during the identical field at least. 

[0048]It passes and photographs and CCD device 23 has the fish-eye lens 35 shown in drawing 
8. The fish-eye lens 35 is formed on the optic axis of CCD image sensor 36. It is made as [ 
picturize / the hand controller 1 with the base level setting up function of a player, etc. / with this 
fish-eye lens 35 / broadly ]. Of course, although the usual lens may be used, since a view 
becomes narrow, the player must lean more heads towards the hand controller 1. 
[0049]Then, the circuitry of the game device 100 is explained. The game device 100 shown in 
drawing 9 is roughly divided, and comprises three circuit blocks. This example explains by 
mentioning the case of the wired system which connects the hand controller 1 and the image 
processing device 3 with a lead. The 1st circuit block is the hand controller 1 with a base level 
setting up function, and the four light emitting diodes LED1-LED4 mentioned above, the 
flashing control circuit 13, the jog dial 54, the manual operation buttons 52, 53, 55, and 56, and 
the control system of those are established. 

[0050]The control system of this hand controller 1 has the intemal bus 18. The interfaces (I/O) 8 
and 9, CPU15, R0M16, and RAMI? are connected to the intemal bus 18. The interface 8 is 
connected to the jog dial 54 mentioned above, and the operation information by a player is 
inputted into a control system. The interface 9 is connected to the manual operation buttons 52, 
53, 55, and 56, and the character directions information by the manual operation buttons 52, 53, 
55, and 56 pushed by the player is inputted into a control system. 

[0051]ROM16 is connected to the intemal bus 18 and control information, such as a system 
program for controlling this hand controller 1 and a read-out procedure of a memory, etc. are 
stored. RAMI? for working is connected to the intemal bus 18, and a system program, the 
character directions information by the manual operation buttons 52, 53, 55, and 56, and the 
operation information by the jog dial 54 are recorded on it temporarily. 
[0052]The character directions information by the manual operation buttons 52, 53, 55, and 56 
read from RAMI? and the operation information by the jog dial 54 are transmitted to the image 
processing device 3 via the interface 9. CPU15 is connected to this intemal bus 18, and 
input/output control of the interfaces 8 and 9, R0M16, and RAM17 is performed. 
[0053]In connecting the hand controller 1 and the image processing device 3 with radio system. 
The transmission section 14 is connected to the intemal bus 18, and the character directions 
information by the manual operation buttons 52, 53, 55, and 56 read from RAMI? in response to 
control of CPU 15 and the operation information by the jog dial 54 are modulated and transmitted 
to a predetermined transmission signal. In that case, a wireless transmitter is used for the 
transmission section 14. An infrared-ray-emission machine can also be used for the transmission 
section 14. 



[0054]the 2nd circuit block is special glass TRON 2, and, in the nontransparentized type case, it 
mentioned above — it passes and photographs and has LCD26 CCD device 23, the usual CCD 
imaging device 25, and for a right eye display, and LCD27 for a left eye display. 
[0055]The 3rd circuit block is the image processing device 3, and has the internal bus 41. The 
interface (I/O) 42, the picture capturing part 43, the image processing portion 44, CPU45, 
ROM46, RAM47, and E PROM(read-only memory in which electric writing and elimination are 
possible) 48 are connected to the internal bus 41. It passes and photographs and LCD26 CCD 
device 23, the usual CCD imaging device 25, and for a right eye display and LCD27 for a left 
eye display are connected to the internal bus 41 via the interface 42. 

[0056]E^PROM48 is connected to this internal bus 41, and the algorithm which combines the 
picture of a virtual body in three dimensions is stored in the external world picture in which a 
player belongs. In this example, an algorithm which compounds the virtual image of arbitrary 
image display devices in the picture on the virtual space of the hand controller 1 which has 
recognized the hand controller 1 which can be picturized at least on the real space where a player 
belongs, and has been recognized there is stored. In this example, the image data for displaying 
the virtual image of image display devices, such as the liquid crystal display 5 or a CRT device, 
is beforehand stored in E^PROM48. 

[0057]If E PROM48 is stored and such an algorithm and image data are placed, For example, if 
the hand controller 1 which can be picturized on the real space where the algorithm concerned is 
read from E^PROM48, and a player belongs is recognized when controlling the game device 
100, Then, based on the image data read from E PROM48 to the recognized virtual image or 
actual image of the hand controller 1, the virtual image of image display devices, such as the 
liquid crystal display 5 or a CRT device, is compounded. 

[0058]Therefore, since a virtual image solid compositing process which compounds the virtual 
image of the liquid crystal display 5 in three dimensions to the external world picture of the hand 
controller 1 which a player operates, and performs graphic display control to it can be performed 
with sufficient reproducibility, The game devices 100, such as a virtual character controller, can 
be constituted with sufficient reproducibility. 

[0059]ROM46 is connected to the internal bus 41 and control information, such as a system 
program for controlling this game device 100 and a read-out procedure of a memory, etc. are 
stored. RAM47 for working is connected to the internal bus 41, and the display information 
which displays the virtual image of a system program, the liquid crystal display 5 or a CRT 
device, etc., etc. is recorded temporarily. 

[0060]In connecting the hand controller 1 and the image processing device 3 with radio system, 
The receive section 49 is connected to the internal bus 41, the transmission signal transmitted 
from the transmission section 14 of the hand controller 1 is received, and a transmission signal 
gets over after that to the character directions information by the manual operation buttons 52, 
53, 55, and 56, and the operation information by the jog dial 54. The character directions 
information and operation information after a recovery are once stored in RAM47. A radio 
receiving machine is used for the receive section 49. Of course, an infrared receiver may be used 
for the receive section 49. 

[0061]It is connected to this internal bus 41 by CPU45, and Control of input and output of the 
interface 42, the picture capturing part 43, the image processing portion 44, ROM46, RAM47, 
E^PROM48, the receive section 49, etc., It passes and photographs and control of input and 
output of CCD device 23, the CCD imaging device 25, LCD26, and LCD27 is performed. For 
example, display control to which character directions information and operation information are 



read from RAM47, and the virtual image of the hquid crystal display 5 or a CRT device is 
changed is performed by CPU45. 

[0062]The usual picture of the four light emitting diodes LED1-LED4 of the hand controller 1 
shown in drawing 10 which the image processing portion 44 was connected to this interface 42, 
for example, was picturized with the usual CCD imaging device 25, It is incorporated into the 
image processing portion 44 via the interface 42 with the control instruction of CPU45, 
predetermined image processing is made there, and it is again transmitted to LCD26, LCD27, 
etc. in special glass TRON 2 via the interface 42. 

[0063]The picture capturing part 43 is connected to the interface 42, and predetermined capture 
processing in which the image data of the blink patterns which a picture of was poured and taken 
in response to the control instruction of CPU45, and were inputted from CCD device 23 is 
gained is made. The image data of these blink pattems is expressed as change of the luminosity 
corresponding to time progress. The image processing portion 44 as a calculating means is 
connected to the picture capturing part 43, about the image data to which predetermined image 
processing was performed, a synchronous gap of blink pattems is amended or the base level of 
the hand controller 1 by which a player belongs is called for. 

[0064]For example, in the imaging range demarcated by the window W which passed in the 
image processing portion 44, photographed, and was outputted from CCD device 23, and which 
is passed and photographed and is shown in drawing 1 1 about the blink pattems of the signal 
(luminance signal) SOUT, It is changed into the spatial arrangement pattern which accomplishes 
four XY planes which pass, photograph and include the luminescent spots P1-P4. Then, the 
arrangement pattern top is scanned and the position coordinate (XI, Yl) of the four luminescent 
spots P1-P4, (X2, Y2), (X3, Y3), and (X4, Y4) are calculated at least. These four luminescent 
spots P1-P4 are the four light emitting diodes LED1-LED4 of the hand controller 1 placed before 
the player. The position coordinate of the four light emitting diodes LED1-LED4 on real space is 
known, and the position coordinate is (xl, yl), (x2, y2), (x3, y3), and (x4, y4). 
[0065]Therefore, the base level of the hand controller 1 on above-mentioned real space is 
obtained by calculating the transformation matrix projected on the fitting location of the four 
light emitting diodes LED1-LED4. if (Xi, Yi) show the point which moved the point (xi, yi, 0) 
on the flat surface of real space by a certain sway-rocking motion here, and projected it on the 
image-coordinates system by transparent transformation - between both - (1) ~ a formula - it 
is related. 
[0066] 
[Equation 1] 

Y • = aixi + a2y i + as 
a7xi +a8yi + 1 



y. ^ a4xi + asyi + as 
^ a7Xi + a8yi + l 



(1) 



[0067]However, al .... a6 are internal parameters, such as an external parameter (a position and a 
direction) of the CCD imaging device 25 etc., and a focal distance, by a strange coefficient. The 
position coordinate (xl, yl) of four points of the known [ parameters / these ] of real space, (x2, 
y2), (x3, y3), and (x4, y4). If the position coordinate (XI, Yl) of 4 sets of image processing 
systems corresponding to them, (Y2, Y2), (X3, Y3), and (X4, Y4) exist, it will be obtained by 
solving the equation of (2) equations, 
[0068] 
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[0069] A base level of the hand controller 1 on real space shown in drawing 10 is recognized by 
connecting a position coordinate (XI, Yl) of four points, (X2, Y2), (X3, Y3), and (X4, Y4) that 
were obtained here. 

[0070]It specifically passes on an arrangement pattern shown in drawing 11 , and a Y-axis is set 
as an imaging direction, when the X-axis is set as a direction which intersects perpendicularly 
with the Y-axis, it passes by the image processing portion 44, and a luminance-signal value is 
added to an imaging direction, a uniform direction, or its counter direction. If this aggregate 
value is plotted on the X-axis, four positions from which a lumdnance-signal value plotted by that 
X-axis serves as the maximum will be detected, and the X coordinate value XI corresponding to 
these four positions, X2, X3, and X4 will be calculated. When an obtained image is scanned in 
the direction of Y on the arrangement pattern, a luminescent spot position which emitted light to 
the beginning among two or more luminescent spots located in a line in the direction of Y is 
respectively searched for as Y coordinate value Yl corresponding to X coordinate value, Y2, Y3, 
and Y4. 

[0071]A position coordinate of the four light emitting diodes LED1-LED4 on real space is set to 
wi (i= 1-4) here. An expression vector on the four camera coordinate system of the position 
coordinate wi of the light emitting diodes LED1-LED4 is set to Ci, When a position coordinate 
on the four LCD screen of the light emitting diodes LED1-LED4 is set to Pi, and is passed and 
photographed, a rotation matrix of CCD device 23 is set to R and the movement vector is set to 
T, they are (3) types, i.e., Ci=R-wi+T... (3) 
However, Ci=Pi-ki (ki is a scalar) 

There is a relation to say. Therefore, since usual rotation-matrix R and its movement vector T of 
the CCD imaging device 25 can be calculated and coordinate conversion can be easily performed 
between real space and virtual space by making this into a parameter. To a base level of the hand 
controller 1 on virtual space, a virtual image of image display devices, such as the liquid crystal 
display 5 or a CRT device, is compoundable. 

[0072]Next, operation of the game device 100 as this embodiment is explained. In this example, 
the four light emitting diodes LED1-LED4 with which blink patterns differ are attached to a 
predetermined field of the hand controller 1 with a base level setting up function which can be 
picturized, It picturizes so that these light emitting diodes LED1-LED4 may be poured to a 
predetermined imaging direction, Image processing of the brightness information of the light 
emitting diodes LED1-LED4 picturized here is carried out, a luminescent spot position of four 
points is searched for, and a case where an external world picture in which a player belongs to a 
base level of the hand controller 1 to which the luminescent spot position was connected on 
virtual space, and a virtual image of the liquid crystal display 5 are compounded in three 



dimensions is assumed. 

[0073]For example, in order to make an image processing system recognize a base level of the 
hand controller 1 on real space where a player equips a head with special glass TRON 2 shown 
in drawing 5 , and a player belongs first at Step Al of a flow chart shown in drawing 12 , A player 
arranges the hand controller 1 on a desk etc., for example so that manual operation button [ of the 
hand controller 1 ] 52, 53, and 55 and 56 side may be upwards suitable. Then, the hand controller 
1 is operated, predetermined voltage is supplied to the four light emitting diodes LED1-LED4 
from the flashing control circuit 13, and it blinks with predetermined blink patterns, 
[0074]In this example, clock signal CLKl of predetermined frequency is supplied to light 
emitting diode LEDl through the resistance R, Clock signal CLK2 which carried out 1 / 2 
dividing of this clock signal CLKl is supplied to light emitting diode LED2 through the 
resistance R, Clock signal CLK3 which carried out 1 / 3 dividing of the CLKl is supplied to light 
emitting diode LED3 through the resistance R, and clock signal CLK4 which carried out 1/4 
dividing of the CLKl is supplied to light emitting diode LED4 through the resistance R. 
[0075]Next, in Step A2, a base level of the hand controller 1 on real space is photoed by one side 
using the usual CCD imaging device 25, and a stereo image is displayed on LCD26 and LCD27. 
On the other hand, it passes and photographs, and a base level of the hand controller 1 on real 
space is passed, photographed and carried out using CCD device 23. For example, since the four 
light emitting diodes LED1-LED4 attached to a position which is going to make it compound a 
virtual image of the hand controller 1 and the liquid crystal display 5 blink so that blink pattems 
may differ, it is picturized so that the blink pattems may pass to a predetermined imaging 
direction. 

[0076]Then, image processing is carried out in order to recognize a base level arbitrarily set up 
on real space where a player belongs by step A3. In the image processing portion 44, for 
example, a subroutine shown in drawing 13 is called, and video capture processing is performed 
at Step BL Then, the four light emitting diodes LED1-LED4 of the hand controller 1 are 
recognized by step B-2. Blink pattems of a luminance signal by the four light emitting diodes 
LED1-LED4 which passed and photographed and were specifically picturized with CCD device 
23 are changed into a spatial arrangement pattern which accomplishes an XY plane including the 
four luminescent spots P1-P4. 

[0077]Scan the arrangement pattern top and at least Then, a position coordinate of the four 
luminescent spots P1-P4 (XI, Yl), (X2, Y2), (X3, Y3), and (X4, Y4) are calculated, and (1) type 
and (2) types which were mentioned above calculate, and A fitting location of the four light 
emitting diodes LED1-LED4 of the hand controller 1 on real space. Relation between a position 
coordinate of four points of an image processing system (XI, Yl), (X2, Y2), (X3, Y3), and (X4, 
Y4) is called for, and a base level is called for by connecting these four points. And at Step B3, 
in the image processing portion 44, data processing is performed based on above-mentioned (3) 
types, it passes and photographs, and physical relationship of CCD device 23 and a base level of 
the hand controller 1 is detected. 

[0078]Then, a return is carried out to step A4 of a main routine of drawing 12 . and a virtual 
image of the liquid crystal display 5 is piled up and compounded on a base level of the hand 
controller 1 of virtual space. At this time, it is made by special glass TRON 2 with which a 
player equipped as [ lead / to an eyeball on the right of a player / one side of a stereo image 
which compounded an external world picture of the hand controller 1 of real space by LCD26 
and a virtual image of the liquid crystal display 5 ]. It is made as [ lead / to an eyeball on the left 
of a player / another side of a stereo image which compounded an external world picture of the 



' hand controller 1 of real space by LCD27 and a virtual image of the liquid crystal display 5 ]. 
[0079]Therefore, on real space shown in drawing 14 A on the left manual operation part 57 of 
the hand controller 1, the right-hand final controlling element 58, and the pars intermedia 59 
(base level), A virtual image of the liquid crystal display 5 can be made to appear on a base level 
of the hand controller 1 in virtual space shown at drawing 14 B although the liquid crystal 
display 5 is not furnished actually, 

[0080]Since a background image of the hand controller 1 on real space where a player belongs, 
and a virtual image of the liquid crystal display 5 which appeared on virtual space are 
compounded in the head by this, The liquid crystal display 5 can exist in a position to which a 
base level of the hand controller 1 on real space belongs. 

[0081]In this example, character directions information is outputted to passing special glass 
TRON 2 from the hand controller 1 by carrying out the depression of the manual operation 
buttons 52, 53, and 55, 56, etc. shown in drawing 14 A. By radio system or a wired system, this 
character directions information is outputted to the image processing devices 3, such as special 
glass TRON 2 which is not illustrated. 

[0082]Therefore, in special glass TRON 2 which received character directions information from 
the hand controller 1, the following image processing is performed that a motion of a character 
should be controlled on a virtual screen of the liquid crystal display 5 shown in drawing 14 B. 
For example, based on character directions information transmitted from the hand controller 1, 
move a character to the left, or. Image processing which carries out the composite display of the 
virtual images, such as a bullet which fly, and a character is sprung, or a character holds, for 
example, was discharged towards an opponent character from arms etc., is performed. A motion 
of a character is controllable on the liquid crystal display 5 shown in drawing 14 B as a result of 
this display control. 

[0083]Thus, by pouring, taking a picture of and carrying out blink patterns by the four light 
emitting diodes LED1-LED4 attached to the left manual operation part 57, the right-hand final 
controlling element 58, and the pars intermedia 59 of the hand controller 1 according to the game 
device 100 as a 1st embodiment. An image processing system can be made to recognize a 
position of the hand controller 1 easily from a position of the four light emitting diodes LEDl- 
LED4. And simple moreover, an image processing system can be made to recognize a base level 
of the hand controller 1 on real space where a player belongs by small computational complexity. 
[0084]Therefore, CRT devices arbitrary as a monitor to the hand controller 1 on virtual space, a 
virtual character controller which compounds a virtual image of the liquid crystal display 5 etc., 
and performs character display control, etc. can be constituted. Compared with a conventional 
system, an operation burden in the image processing portion 44 is mitigable, and a cost cut of 
these virtual character controllers can be aimed at. 

[0085] (3) Game device drawing 15 as a 2nd embodiment is a figure showing an example of a 
circuit block of the game device 200 as a 2nd embodiment concerning this invention. In this 
example, wireless-ization is attained by connecting the hand controller 71 and image processing 
device 3' with light. 

[0086]The game device 100 shown in drawing 15 is roughly divided, and comprises three circuit 
blocks. The 1st circuit block is the hand controller 71 with a base level setting up function, and 
the four light emitting diodes LED1-LED4, flashing control circuit 13\ the jog dial 54 and the 
manual operation buttons 52, 53, 55, and 56, and a control system of those are established. 
[0087] Although a control system of this hand controller 71 takes the almost same composition as 
a circuit shown in drawing 9 , it differs in [ that ROM72 is provided ] that flashing control circuit 



13* is both controlled by this control system. Since the function of a thing of the same numerals 
as a 1st embodiment and a name is the same, it omits the explanation. 

[0088]That is, the control data Dp for controlling blink of the light emitting diodes LED1-LED4 
based on input by the jog dial 54 and the manual operation buttons 52, 53, 55, and 56 is stored in 
ROM72 connected to the internal bus 18 of the hand controller 71. In this example, the control 
data Dp is beforehand formed into a reference table, it is stored in ROM72, input by the jog dial 
54 and the manual operation buttons 52, 53, 55, and 56 is made into an address, and the control 
data Dp is read. 

[0089] This control data Dp is outputted to flashing control circuit 13' through the interface 9 in 
response to control of CPIJ15. Based on input by the jog dial 54 and the manual operation 
buttons 52, 53, 55, and 56, blink patterns of the light emitting diodes LED1-LED4 are controlled 
by this flashing control circuit 13\ Drawing 16 explains this flashing control circuit 13'. Blink 
patterns by the light emitting diodes LED1-LED4 are detected by special glass TRON 2 of the 
2nd circuit block, for example, in a nontransparentized type case, it mentioned above — it passes 
and photographs and is detected by CCD device 23 or the usual CCD imaging device 25. 
[0090]This photodetection signal that passed, photographed and was acquired by CCD device 23 
or the usual CCD imaging device 25 is recognized by image processing device 3* of the 3rd 
circuit block. ROM73 other than ROM46 is provided in this image processing device 3', and it is 
made as [ ask / from this photodetection signal / input by the above-mentioned jog dial 54 and 
the manual operation buttons 52, 53, 55, and 56 ]. for example, input by the jog dial 54 and the 
manual operation buttons 52, 53, 55, and 56 which were beforehand matched with ROM73 by 
photodetection signal ~ reference ~ a table ~ being-izing, and it being stored and. This 
photodetection signal is made into an address and input by the jog dial 54 and the manual 
operation buttons 52, 53, 55, and 56 is read. 

[0091]Input by the jog dial 54 and the manual operation buttons 52, 53, 55, and 56 which were 
read from this ROM73 is stored temporarily in response to control of CPU45 RAM47. Image 
data about a position of the four light emitting diodes LED1-LED4 as well as a 1st embodiment 
is stored temporarily RAM47. Input by image data, the jog dial 54, and the manual operation 
buttons 52, 53, 55, and 56 about a position of these light emitting diodes LED1-LED4 is carved 
and read from RAM47 to the image processing portion 44, E^PROM48, ROM46, etc. 
[0092]Then, flashing control circuit 13' of the hand controller 71 is explained. Drawing 16 is a 
block diagram showing an example of an internal configuration of flashing control circuit 13'. 
This flashing control circuit 13' has the clock generation part 61, and clock signal CLKO of 
predetermined frequency is generated. The four frequency dividers 81-84 are connected to the 
clock generation part 61, and dividing of clock signal CLKO is carried out by a predetermined 
division ratio in each frequency dividers 81-84 based on the control data Dp inputted through the 
interface 9. 

[0093]For example, when the control data Dp concerning the jog dial 54 is supplied to the 
frequency dividers 81-84, dividing of clock signal CLKO is carried out based on a division ratio 
of the 1st pattern. When the control data Dp concerning the manual operation button 52 is 
supplied to the frequency dividers 81-84, When the control data Dp which dividing of clock 
signal CLKO is carried out based on a division ratio of the 2nd pattern, and is applied to the 
manual operation button 53 is supplied to the frequency dividers 81-84, When the control data 
Dp which dividing of clock signal CLKO is carried out based on a division ratio of the 3rd 
pattern, and is applied to the manual operation button 55 is supplied to the frequency dividers 81- 
84, Dividing of clock signal CLKO is carried out based on a division ratio of the 4th pattern, and 



when the control data Dp concerning the manual operation button 56 is supplied to the frequency 
dividers 81-84, dividing of clock signal CLKO is carried out based on a division ratio of the 5th 
pattern. 

[0094]The clock signals CLK1-CLK4 outputted are supplied to each light eniitting diode LEDl, 
LED2, LED3, and LED4 through the resistance R for stabilization from each frequency dividers 
81-84. Therefore, the light emitting diodes LED1-LED4 blink so that blink patterns may differ 
based on the clock signals CLK1-CLK4. 

[0095]Thus, according to the game device 200 as a 2nd embodiment, the light emitting diodes 
LED1-LED4 can be blinked with blink patterns based on input by the jog dial 54 and the manual 
operation buttons 52, 53, 55, and 56. And input by image data, the jog dial 54, and the manual 
operation buttons 52, 53, 55, and 56 about a position of the light emitting diodes LED1-LED4 
memorized by RAM47 can be carved, and it can read to the image processing portion 44, 
E^PROM48, ROM46, etc. 

[0096]Therefore, based on character directions information by the jog dial 54, the manual 
operation buttons 52, 53, 55, and 56, etc. which are sent from the hand controller 71, a character 
can be moved to right and left, or image processing on which it flies to and a character is sprung 
can be performed. And since no troublesome wiring cord like a 1st embodiment is connected to 
the hand controller 71, the hand controller 71 can be operated with free feeling. 
[0097]Since the liquid crystal display 5 or a CRT device is displayed on LCD26 in special glass 
TRON 2, and the displaying means 24 of LCD27 grade in each embodiment, things, such as the 
disk top*s CRT device and a liquid crystal display of note size, become unnecessary. A size of a 
liquid crystal display on virtual space and a screen of a CRT device can be decided freely. 
[0098] Although each embodiment mentioned above explained the hand controllers 1 and 71 
about an information input device, since it is not restricted to this, and the position can be 
recognized if it is an information input device with a light emitting diode, it may be what kind of 
information input device. 

[0099] Although each embodiment explained a case where a virtual image of the liquid crystal 
display 5 was compounded for the hand controllers 1 and 71 on virtual space, it is not restricted 
to this and may be made to compound a virtual image which imagines arbitrary characters. As an 
example of a character in that case, 3D polygons, such as a snowman, a plinth polygon, light, 
flame or an icy polygon, and a polygon still like armor are applicable. 
[01 00] Although this embodiment explained a case where nontransparentized type special glass 
TRON 2 or transmission type special glass TRON 20 was used, of course, it does not matter 
even if it is not restricted to this and uses special glass TRON of a combination type which can 
switch a transmission type and a nontransparentized type. 

[0101]The game device 100 of this embodiment JP,10-123453,A, JP,9-304727,A, JP,9- 
304730, A, JP,9-21 1374,A, It is applicable to a transmission type head mount display indicated to 
JP,8-160348,A, JP,8-94960,A, JP,7-325265,A, JP,7-270714,A, and JP,7-67055,A. 
[0102]Although this embodiment explained a case where passed and photographed and a two- 
dimensional imaging device of an interline transmission mode was used about CCD23, it is not 
restricted to this, and same effect is acquired even if it is a case where a two-dimensional 
imaging device of a frame transfer system is used. 
[0103] 

[Effect of the Invention] As explained above, according to the information input device of this 
invention, the control means which carries out flashing control so that the blink patterns of two 
or more light sources attached to the specific position of the adjacent spaces of a manual 



operation button may be differed is established. 

[0104]When it passed and photographs by this composition and an information input device is 
picturized with a special-effects device like a CCD device, compared with the case where non- 
flashing control of the lighting pattern of two or more light sources is carried out, the position of 
that light source can be pinpointed easily. Therefore, since an image processing system can be 
made to recognize the position of an information input device easily from the position of the 
light source, it is fully applicable to a game device etc. which compound the image picture of 
arbitrary image display devices to an information input device on virtual space. 
[0105] According to the game device concerning this invention, an above-mentioned information 
input device is applied. This composition can constitute CRT devices arbitrary as a monitor to an 
information input device on virtual space, a virtual character controller which compounds the 
virtual image of a Hquid crystal display etc. and carries out display control of the character, etc. 
This invention is applied to the game device adapting the position recognition mechanisms and 
this which make an image processing system etc. recognize the existence position of an 
information input tool with a manual operation button, etc., etc., and is very preferred. 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing li lt is a perspective view showing the example of composition of the information input 
device 1 as an embodiment concerning this invention. 

[Drawing 21 It is a block diagram showing the example of an internal configuration of the 
flashing control circuit 13. 

[Drawing 31I t is a wave form chart showing the example of feed voltage to the four light 
emitting diodes LED1-LED4. 

[Drawing 41I t is a perspective view showing the example of composition of the game device 100 
as a 1st embodiment adapting an information input device. 

[Drawing 51I t is the key map seen from the transverse plane which shows the example of 

composition of special glass TRON 2 used with each game device. 

[Drawing 61I t is the key map seen from the transverse plane which shows the example of 

composition of other special glass TRON 20 used with each game device. 

[Drawing 71 It is a top view of the special glass TRON 2 in which passing and photographing and 

showing the example of an internal configuration of CCD device 23. 

[Drawing 81 It is the sectional view in which passing and photographing and showing the 

example of composition of the optical system of CCD device 23. 

[Drawing 91 It is a figure showing the example of a circuit block of the game device 100. 

[Drawing lOl It is an imaged figure showing the example of a usual picture of the left manual 

operation part 57 which accomplishes the base level, the right-hand final controlling element 58, 

and the pars intermedia 59. 

[Drawing Ul lt is a mimetic diagram showing the example of calculation of the position 
coordinate of the base level. 



[Drawing 121 It is a flow chart of the main routine which shows the example (the 1) of the game 
device 100 of operation. 

[Drawing I31 lt is a flow chart of the subroutine which shows the example (the 2) of the game 
device 100 of operation. 

[Drawing 141 A is an example of a real image of the hand controller 1 on real space. 

B is an imaged figure showing the synthetic example of the liquid crystal display 5 on virtual 

space. 

[Drawing 151I t is a figure showing the example of a circuit block of the game device 200 as a 
2nd embodiment adapting other information input devices. 

[Drawing 161I t is a block diagram showing the example of an internal configuration of the 
flashing control circuit 13\ 
[Description of Notationsl 

1, 71 ... A hand controller (information input device), 2, 20 ... Special glass TRON (synthesizing 
means), 3 ... An image processing device (calculating means), 4 ... Position recognition 
mechanisms, 13 ... Flashing control circuit (control means), 23 ... It passes and photographs and 
is a CCD device (imaging device) and 24... Displaying means, 25 [ ... A vertical transfer part 
(charge transfer section) 33 / ... A horizontal transfer part, 100,200 / ... A game device, LEDl- 
LED4 / ... Light emitting diode (light source) ] ... A CCD imaging device, 26 ... LCD for a right 
eye display, 27 ... LCD for a left eye display, 32 
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■\'«7)Ay F 3 y h n- 7 1 1 . ^*^J|6{«§iX!t?SfBT -f 
LCD2 7*iKWtA>il, l^cOAyHayhD-^l 
[00421 Z<rm!S^iryXhtiy2iir]^-^<7)^ 

ximmzm^^ii. im^olc d 2 6<r>XTV^m%. 

LCD27 co;^,r U:tpimi: *>'r^— ^<?5|^tS 

< J: a K^^it-cv^s . crnt J: 0 . 'TV—>^<nmth 

'W^^tLx<Df\yY^yYn-yih. m^BT^xr 

V4 5ffimMmi:.\m(^^X'^}^^ilh . 
{00A3\m€>\iZ7r;tWk^'^XVuy20\mm. 

<ryK-y Y-^^yvf ^ xrv-iiimLLxn'o . ii^o 

cc\)m^m.2 5\mm^fix\^^j:\^. m^x. 
■:2 3i:. 9[-^mi'oiiL:^m<omik>"^'y 9 28 1. m 

fil^^^i^t UttfOL C D 2 9 ^ WLTV^I. . 

[00441 Mttf . ru-^<7)M^izmt?>&miz 

ii. gS[La')CCDgS2 3*«iIB$ti. v*«s 

>'NyHayhn-7lO4ffl<0^:J^-<:t-HLE 
Dl~LED4*«aE Lao ^-LT. rv— ^'O 

?ssi^^ «y 2 8i:m&Ltzru—v<Dmzm\''>t:f\y 
H 3 y h 0-7 1 <oiifii*qi:«K«tc»*»tLi. . 

[0 04 5] ttz. ^^/7Xhoy2rt07*lx— 

mhtL. }:Mc^>m^^^xhx3y2tmzbXWiS, 

mmmti^^^tlh, ia^L^:C^J&»\ )Ra>'^>y^'2 
Si. LCD2 9i:(J0Sfctt(iJtt'-i^xrU7^'^rff 

i:LT<7)>'NyK3yhn-7li:, Miaf^xru-iS 

coimm&ti,m<n'^x'-^&(,^iih . 

[00461 iB[V^T> 'fy^-5'f>'lKili:Sr5COiiiEL» 

'5CCD5IS230l*lgS«fi!t{C-P»r>TiKBg-ri). I17(: 



lX7*h^^t-]^PHi j (i = l~n, j = l->- 

[0047] Z<7)mLmmf^Uim^mkUii LXm 
*OfteKj*gP3 2*«iS(t^>il. 7*hy^:t-b'PH 

i j ti^hM^ti!itfcm^Wi¥mm.^^iiiLiS^s 1 1 
a^v^TSitfrrfi] (SiLao:^ifii) iclEjiis^ts. z<d 

m^ti6m\ !lj:>jffl^3 4WiSLaofi^souw 

- H P H i j *^^>Sil:tej*SP 3 2 tcft-^«?^*>'S?;%^iii$ 

[0048] tJt. 85ta')CCD^a2 3l±ll8tC^ 

■r«^>-X3 5$:fl•t•CV^§. ^|gU->X3 5{ifi?iJ;c 
(f C C HWm'f 3 6 mMlizWiM^htli, . ^ <0M8 

[ 0 0 4 9 ] , y-JU^S 1 0 0 C7)li]gg:^^ to 

V ^TiJiBHt 6 . II 9 \,zifcfy-j>.mw. 1 0 oti;*:^ < ^ 

{tT3oc7)|H]S&7'D-y^*>^>^l). iOfiaiTli. AyH 

a y h a-7 1 1 misk^m^m. 3 1 s: u - Higt-sgg-r 

0. ±aUc40C7)^5fe^-<:t-KLEDl-LED 
4. A«S0J1»lHlffil 3, i;3i^yA\)V5A. 
^5 2. 5 3, 5 5, 5 6at^-?-«0$iJ»^^3&SiStt'5>tl 

[00 5 0] ::<7)Ayh'3yho-51«0$ip^{i:i*lSf 
X(I/0)8. 9,CPU15, ROMie&tfRA 

3, 5 5, 5b{,z\,i^y^y3.-x9timU^ii. 
V(cJ:o-CJfT$ilfcSf^d^^'>5 2, 5 3, 5 5, 

dsizxh^^^^f i^mmmmmmzxfjttii . 
[0051] mz. rtgp^'x 1 8tc{iROM 1 etimu 

RAM 1 TA^SS^it, i^XTM.rayyM.'^. Jlf^-K 
:J'y52, 53, 55, 5 6^^J:-5.df^r5^'^f§*'IB« 

g 5 4 J: hmmtifi-mm^ tl 
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[0052] ttz. RAM 1 7f)^m^tii^tltzmi¥::i'^ 
^1/52. 53, 55, 5 6{cJ:l)'^f^5^'^fgS^ 
^'J 3 -^/l' 5 4 J: SSW^fi^li-f y 7 x-X 
9^:rt-tTBfilJ!ia^M3(;:fS*$ii.So CicortSPAx 
18fcUiCPUl 5*«S^$a, W>-:J'7x-X8, 
9, ROM 1 6&IXRAM 1 7 ffiX'^-hWUfi^htl 

[0053] ^fc, ^^y}^:lyha-yltmW^9m^ 

s.3t imMk-mxmmh^izii. rtsu^'^x 1 8tc 

jiftS?14Srg^g?L, CPUl 5<?)$lJffll&gttTRAM 

1 7*»^>^^JiJ$>L7tSf^'i^^>'5 2, 53, 5 5, 5 

6 J: S ^ A- 7 ^'fgS^ffffi^ V 3 ^^rJ^^ 5 4 (c j: 

-ec7)|gt{iillfig|5i4{c{iiiilS5Mffi§S*5<g^$fi|>. ii 

fiSB 1 4 izmm^mimth nthx^i, 

[ 0 0 54 ] l|20|lIffi7'D>y^Ji!NB*^'5Xhny2 

a2 3, a?scoccDaMii«2 5, tas^^ffliOLc 
D 2 eawfitaR^ffloL c D 2 7 Sr^r tr v^i) . 

[ 0 0 5 5 ] |g 3 -y JiBfilJilia^a 3 -c* 

0, i*iS^<;^4lS:^rfCv^|.. •^x 4 1 (cti-f y 

:J'7x-:^ ( I/O) 4 2, ffl«=iE-\'7'^-vgi54 3 , M 
#JQaSE44, CPU45, R0M46, RAM47R 
IX E 2 P R O M ( SMW^S § a^atX}M**^*^lg^rM 

;^^aiL»ffi^*'j) 48mmtix\i^?>. sllsoc 

CDIIS2 3, 9^<0CCD»(i$IX2 5, 

L C D 2 6 at^£K^ffl<7) L C D 2 7 (i y :^ 7 X 
-X4 22::n-L-CrtSP>'U4 lK^$ixS. 
[00 56] COrtgSA*;?.4 lt{iE2PROM4 8*« 

mm^ti. ru-^(r)m-fm^mz{m.wcommiL 
i^mz^^t^7j\^doxM,i}it?,t(i^ix^, zmix 

J4, i!'-=5:<fct>, TP— VWS-rS^ia±Tli«^tl 
^AyH3yhD-7 lS-i2i^L, -eciTlg^^n/cA 

yH3yha-5i com.s!^±(ommzQ:mcommm 

ClcO^'ijT-ti, ?gftT-fXr^'( 5, XtlCRT 

^f—9ifi^»>E^PR0UA8<,zWlh^ixX\>'>h. 
{0057^ ^r;P:f U XASt««T-^ ^ 

E2PROM4 8 5-tgif|^LTB<i:, i^-ASI 
ffll 0 OiJ:SiJ{SI1-|>ISgtc, '^WiVdi}XL.ifiE^PR 

nsil^ fL7t>' N y H 3 y h o- 7 1 OiRSB^XtillB 
filt, E2PR0M4 8*»/5B!;^ai$<iJtH»T-^'t 
S-CfV^T, ?S^T-fXr^>f 5, X(lCRTga:5:t'eD 

Bfii^s^ffl«7)(g=ga^i^B£§ I, . 

[ 0 0 5 8 ] T , ri/— V(?D»fm> A y H n y h 
0-7 1 (JD^'UftRt, ?SftT'fXrw-^5co<KBB«* 
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— ?-v;^^■^'5^'^'3:^ho-7^^i:'o>■'-Ailal o 

C 0 0 5 9 ] rtgPA'X4 1 UiR0M4 bifi^W. 
Six, C:<Dy-A5iai0 0S:$iJffll-fS!ti6<OvXrA 

t'i^lSittS^ixl., I*1IPA'X4 i{c(i:y-dfyi/fflc7)RA 
[00 60] :5rfc. AyH3yhD-7lfcH«^0iail 

jllfi-^*5J8#.K^'y5 2. 5 3. 5 5, SeCil.df-v 
{iRAM4 7fc-a.1g«i§ai.. Sffil»4 9W±iEg5S 
[0061] Z<7)fyWiX4 1 IZliC P U4 5*>'»ig$ 

it, y^'7x-:^4 2, B«^^7'^^rgB4 3, Bfil 

MagP44, ROM46, RAM47, E2PROM4 

8 aiA'SftsB 4 9^ t' <^Aai :^<7)$fj{ai^ , ss tti o c c 

Di^S23, CCDafi^a25, LCD26ai/^LC 
D2 7«Afil:^JCOSiJffll3!)«ff*>itl.. mtf, RAM 4 7 

^;^7-U-f 5, XttCRT5IB^ifc7)fli«B«l^^^bS 
^tlio ^s^mim^C P U 4 5 K: i r>X^h1X?> . 
[00 6 2] Z(7)-{y^y3:-X4 2iZlim^9m34 

4mm^ii. mm. a^«occDa<iiiB2 5-cii 

1 0 t^f H n y h D-7 1<04 

5t^^:t-KLEDl~LED4iOa^Bffi*<, CPU 
4 5cO®Jffll#^tfttw-^y:?7x-X4 25rJ>LT, ® 
mmW'44l,zM*)iihtix. -?-::f0r^coaffi«SI*^'5r 
§ii, St^, y^'7x-X42S::n-tT#^7'7Xf 
□ y 2 1*1 «0 L C D 2 6 L C D 2 7 tXIEiM § a 

[0 0 6 3] ^it, 'f y^7x-X4 2JC{iBtfe#-\'r 

i-\U4 3tf^mm$tl. CPU4 5£7)$lJ»^<^5rg(t 

t . ^ (r)Amf^i>-y<m^f-'?(ii^wm\,znm-t 



4 3 Lxm^wm4 4f}<im^ti. 

fn^m^nsmm^ti^mmT-'^izmix. 

[0064] ^xtf, Bil»!SSB4 4Tti;gStS0CC 

D||12 3*>^ai:Jj$ixyiSELa'5^-^ (WJSfi^) s 
0UTc7)^^n-^'- y{cM LT , II 1 1 K^-rnr-f y H 

P 1~P4 S:#tfXYTil&)ife1-^W^rieKA-:J'-y 
tSE^SitS. -ecof^, -e<OES>'N-^'-y±?:^L 
T,::!'-^<tt, 4o<7)»^P l~P4£0fiaS^ (X 
1, YD , (X2, Y2) , (X3. Y3) , (X 
4, Y4) ***ft<oitS. Z<^4^m^P l~P4{i: 
rw— \'^OB5^-^*^i^5t>'^y y 1 i04o<0 

563K^'fjr-HLEDl~LED4-C'ib&. SI^JKO 
4 OCO^^^^f Jf- H L E D 1 ~ L E D 4 <Ofia^{l 
ia»I-C'J) 0 , (xl, yl), (x2. 

y2), (x3.y3), ( x4 , y 4 ) T'ibS. 
[006 5] IS^oT, Ji^col^mit^AyKnybn 
-51 (7)^J?ffi{i4 -:)C0l&3t^^ H L E D 1 ~L E 

D 4 oiRftitffistcwi^-r s^^T?ij$r?a»-r s etc 

J: *}nhti&. ZZ-C^m<7yf-m±<^A ( X i , y 
i, 0) S:J)I.Mjt • lHlKaH!)(cJ:oT^»iL, -eii^ 

mmmx-mmm^izmifzAi (x i . y i ) -c 

[0066] 
[iicl] 



y. _ aixi +a2yi + aa 
a7Xi+a8yi + l 

y. _ a4Xi + asyi + as 
a7Xi + asyi + 1 



(1) 



[0067] flL, a 1 • • • • a 6 {i^ao^ScT'C 

cDa<iisa2 5^:fc'<o3'ha5A-7^-^' ((agfc:tri6i) 

7;><-^«ill^S«^Stac04-:)<0^c7)filFMSS ( x i , 
yl), (x2,y2), (x3.y3), (x4,y 

4) ^, ^tihiiznm-ri4m<om&m3kffMSsm 

(XI, yd , (Y2, Y2) , (X3, Y3) , 
( X4 . Y 4 ) ( 2 ) ^<7)1jm.t:M< 

ztizx>on<»ti.h, 

[0068] 

m2] 



I 
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fxi^ 




fxl 


yl 


1 


0 


0 


0 


-Xlxl 


-Xlyl ' 




a I 


X2 




x2 


y2 


1 


0 


0 


0 


-x2xa 


-X2y2 




a2 


X3 




x3 


yS 


1 


0 


0 


0 


-X3x3 


-X3y3 




a3 


X4 




x4 


y4 


1 


0 


0 


0 


-X4x4 


-X4y4 




a4 


Yl 




0 


0 


0 


xl 


yl 


1 


-Ylxl 


-Ylyl 




a5 


Y2 




0 


0 


0 


x2 


y2 


1 


-Y2x2 


-Y2y2 




a6 


Y3 




0 


0 


0 


x3 


y3 


1 


-Y3x3 


-Y3y3 




a7 


Y4 






0 


0 


x4 


y4 


1 


--Y4x4 


~Y4y4^ 




a8 



[0069] c:::T1#^>^i/t4j±(co{ii:«g (x i . y 

1 ) . (X2. Y2) . (X3, Y3) . (X4. Y 
4) ^rtS^ClfctiO. 01 OtcS^U^IimJbOAy 
K 3 >- h n- 7 1 (Ti^Wfi^^iih . 

[0070] mm^\t. m 1 1 \z^^^w^^-yiL 

h> C:c7)Jiii|[ffl*«X|S±tcrn>yhSnSfc, ^coxfft 

tT-o -y h ^ h.fzJmm^1f^h =5: 1. 4 oiOfiS** 
Wi^ii. ;tf04oioe»cMJEL?tXJSSfflXl. X 
2. X3, X4*5*<6^>tlS. ^<mM.n9-> 

±T'K#B«&Y:^ri6]{c^L/ifc#{c. ^<n-\-H^\z 

^xmmmi>ziHiiLt:Ymmm.Y 1 . y2. yb. y4 

[ 0 0 7 1 ] i cir, 5ISra±^04-Pc7)IBKr>f Jj-- F 
LED l~LED4c0fiSiS©Srwi (i =l~4)i; 
L, ^■(?>40^7>563ty>f5j--HLEDl~LED4<?)fi 
SJiSw i cT);^^ ^JiS^±-CO^^^' h;l/2:C i b 
■?-<04OO^3fe^^-^5f-HLED 1~LED40L 

c Dmm±Tm.mm^ Pitb.mim'occDm 

ttt. (3)^. t^i5*>, 

Ci=R- wi+T • • • (3) 

fit, C i =P i ■ k i (k 

Zixi:^^yyt-i}' b lX^^bWm.mb<r>^Tm 

^i^^izno ZbtfiXt 1<^X\ (RffiSra±<7)VNy 

z b m-t h . 

[ 0 0 7 2 ] imwn'm.b \^x(^f~hmm. i 
ooc^iM^^giBjfs. zffimxxt. mmw^m^ 

A-^- - ytmtnh 4 ocO^TtrJ^^ jf- F L E D 1 ~ L E 
D4&BXWt, C:il'3C0^:}^'f;t-HLEDl~LE 

D 4 ^m«<^SI«:S-|&lt=«t J: ^ ^zWSk L , c: -caift 

$iX7t^/^ ;t-HLEDl~LED4 m^im. 



' • • (2) 

^m-mz^mh^-^^^^-fh. 

[0073] mxM. rv-^\m 5 tc^ 

Fioxf-yT-A 1 t-rw— \'coJg-f i>^ra±-c 

«»f^;f:^y5 2. 5 3. 5 5. 5 6{i*>±{Cl6l< j; 3 

1 3*»/i4-?c7)ifiBe^-^Jt--KLEDl~LED4tE)f 

[0074] i<0««m4. BlrgjilS^W^' o -y ^ft-^C 
L K 1 imSi^^'M. LX^i^^ H L E D 1 izm 

•y ^'fi#C L K 2 imURmLXmir^ 3j— H L E 
D2t«l&;5<t. •eoCLKlS:l/3i)-jgLJt^'D>y 

^-fi^C L K 3 AmiffRSr ii LT^r-^ :t- H L E D 

f|#C L K 4 imtUR m LX%%y^ jT- H L E D 4 

izm^fih, 

[007 5] x^-vrh2{zii\,yz. -^rt-jl^ 

<^C C Da<^S2 5 Srfigffl LTl^S±OAy Ha y 
h 0-5 1 COSS^H?: ai^ LT L C D 2 6 L C D 2 

7(:xf-^jrB«$-^^^-ri.. fi6:^rt'. cELSOCCD 
ilB2 BSrffifflLTHSmiOAy Hay ho-^ icT) 

^iiS-atSO-r?.. ^;ttf. AyH3yho-51 

bm^T-i xru-i 5 b<r>MMmmt:'^!&^^x a bt 

h^mizmUfkfVfz 4 'JC^^^J^^f ^- K L E D 1 ~ 
LED4*^ ^W<if-ym^j:hl:olzAmtihffi 

x\ ^<7)^w<i'-ymM(ommij^i>zWitxoi,zm 

[0076] ^ffM. XfyrA 3X'ri'—^<nmth 
l^iatfcttS t iSS ? tL;t«Sffi S: urn- htdsb tB 

mm.-th. mmmuAAX'\t. mm. 01 3 

■Mfy;U-f-ySr3-;PLT;^-f yrB 1 ■Ch'T;t^^ 

rf-ir»ra?rl^-r'&. ^<r>Vk. ;^T-y7*B2T'AyH 

3yha-7l<04-5C^^/-f :t-HLEDl~LE 



(ao) )00-1 72431 (P2000-172431A) 



nm^tdiA-yffm^r-^ sr- H L E D 1 ~L E D 4 

til. 

(00 77] -eco^s -e^OESA^-yi^^UT^ 

'J'-^j:<ki>. 4O£7))Wj±iPi~P4i0{aBJia (XI , 
YD. (X2,Y2). (X3,Y3). (X4.Y 
4 ) mibhtl. mitx ( 1 ) ( 2 ) ^*«iSj«[ 

ll2g^±^0>'NyK3y lc7)4-PCO|67t:/ 
-fyr-h'LEDl~LED4c7)E#ftfii[ak, BfliJOa 
^<04^c0fi[affiS{Xl. YD . (X2,Y2), 
(X3, Y3) . (X4. Y4) bcomm^^if>(>tl. 

i^-^^^xmn-mmtfinhti. sse l» o c c dsim 2 3 

ill, 

(0078] ^<7)ik. mi2a)^^y)V—^y<r>XT'7 

xYuy2X'ii. LCD2 6(cJ:§|8^Sc7)>'NyK3y 
^m<XoiZ^£^til. LCD2 7tJ:SIISS<7)W 

[0079] t^oT. 014 A^ZJ^'tm.'&^lX'W^y 
H3>'ho-^lC02c#^*f^a55 7. ##j*f^g|558& 

(0080] wixfc i •} . 7V—^<nw,-th^^±.<r> 

(0081] iCOgj-Cfi, la 1 4 AfcS^ttSf^'-K^' y 5 

2, 5 3, 5 5X{±5 6^fc'J»T1-S::i:dor, 

Ay F 3 >- h 0-7 1 *>^>!^^^^7;^ h ny 2Mw^i' 

Mimmxmm^izi.*) . la^t^rv^i^^'^x 

h o y 2 ^: i: tfOHTOS^S 3 tffi^J $ ni. . 
[0082] ta!-5-C, ^NyF3yhP-51*»4)C0^-\' 

9^^f§^flm*S<iL/S!|*ai^^9:^hDy2T{i. @ 



h, mxM.. )\yY-r:iyV'0-y \t^m!^^iiX<h 
^■xr'y99Wf^^zm^\\X^-<t'^99^W;zms'L 

m-h. 'Skx.\if^j:)it^hm^^^'y7^^zmx% 

[0083] z<r)i. o^z^^x <r>%wm.t ixcoy- 

Aga 1 0 0 iixJf , >'^yH3yho-7 lco:t^ 

5 7 . *#«f^aj 5 am^^m 5 9 Kixtttt 4><t 

;t 4 Oc7)|&7Kr-f Jf- K L E D 1 ~L E D 4 ± I. j^tM 
A-:J'-yS:ffiUai5-ri.ii:fc<J:''-C, 4o<50lBt/^ 
:t- K L E D 1 ~L E D 4 COfi[a*»^»'^y h' 3 y N P- 

7*1^— V^OiS-tl.llS^oyNyKayh 
[0084]^a!o•c. {EgSra±tvNyh-3yho-^ 

itstri.^-^'tLTffisocRTm^. ?aB^BT-< 

ffllSrff ^ <t 3 ^A'-f-^/Udf ^ 5 ^J' 3 y h 0-7=5: i: 

mu4 4izmhmM-kmmmx'^it^iz. zti 

^yimi:ibifiX'%h. 

[0085] (3 ) m 2<oitsBg®t Lx<r>y-j^^m. 
m\ 5\i^wm^hm2ffmmmtLx<r)y-m 
w.2oo<r>m^->''a-/^m^^-tmx'hi. :L(r>mx' 
a. f\yY^yvu-yi t^tt 
xmti:.bizx*). "^^f-^uxitm^titffixi) 
I. 

[0086] 11 5iZ7rity-J^mS.l0 0iiiz^<^ 
(tT3-3C0lliK7'P«y^'*»'?>figa. IgKOHIKT'P-/^' 

imm&^mm ony k3 y h p-5 7 1 t'S> 

0, 4-:3C7)^y.^:t-h'LED 1~LED4. ^jg$IJ 
»|5Iffil3' , j^3^^/'<-^;P5 4. iif^;K^'y5 2. 

5 3, 5 5s 5 6m^<m9i^imi'rhtii. 

[0087] Z<D^\yVayhn-y7 lcr)mmmm 

9i,z7rsttzm^tiimnm^j:n^i^nfi. rom7 2 
imi-rti>tii^iz. zmmmzx-oxj^mm^i 

3' t>mm^tilAX'M^j:r>X^^l. =5r*5, micoUte 

(0 088] 0^0, AyK3yhp-57 1<7)|*|*Pa' 
X 1 8 R O M 7 2 1 ti 3 5 4 

&t^^lf^.■^^^'y5 2, 53, 55, 5 6 c j: s A:^3tilffl 

C3lrJV^TI63t^'f ;f-HLEDl-LED4 

$'HJ|l^l.^cy)0©Jffl)T-:5'Dp*5i(SS^Sil-C(,^|,. 
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y52. 53, 55. 5 6KJ:l)A^J'tSf8^rHU:!^K 

LTSJffllT- ^' D p A^BI^ai ^ ill. « 

[0089] zmmf-i^Dpitcpuisff^mm 

gttT'fy^'7x-;^9S:a-oTjSiji«(lffliIlI!&13' t 

)V5Am/m^^^^y52. 5 3. 5 5, 5 6CJ;I)A 
:*jfll?8{cSr?V^T^:J^-Y:t-KLED 1~LED4<0 

-Pir^Ttilll 6f^Bfl$:-ri., |&7t/-f ^r- K L E D 1 

~L E D 4 {zii hmj^^-y^m 2 <r>m^f^ -f9<n 

^i/7Xhoy2fcj:r.T«itiiStii.o mm. im 

jiMWJ^Wi±)*L/cStaOCCDga2 3X<±, 
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